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A method for buffering packets transmitted to an 
Infiniband port by an Infiniband device linked to the 
port, comprising: 

providing a portion of a memory for buffering the 

packets, wherein the portion has a size A; 
transmitting flow control credits to advertise to the 

device buffering resources of a size B, wherein B 

is greater than A; 
determining when the portion is filled with a 

predetermined amount of the packets; and 
transmitting flow control credits to the device to stop 

transmission of the packets in response to said 

determining. 

The method of claim 1, wherein said transmitting flow 
control credits to advertise to the device buffering 
resources of a size B comprises transmitting flow 
control credits to the device for a plurality of 
Infiniband virtual lanes configured on the port. 

The method of claim 2, wherein said plurality of 
Infiniband virtual lanes comprises a number of data 
virtual lanes from the list consisting of fifteen, 
eight, four and two. 



BAN: 0104 



The method of claim 1, wherein said transmitting flow 
control credits to the device to stop transmission of 
the packets comprises transmitting flow control credits 
to the device for a plurality of Infiniband virtual 
lanes configured on the port. 

The method of claim 1, further comprising: 

providing a second memory for buffering the packets 
transmitted subsequent to said determining. 

The method of claim 5, wherein said second memory is 
coupled between the port and the first memory. 

The method of claim 5, wherein said determining the 
portion is filled a predetermined amount comprises 
determining the portion is approximately full. 

The method of claim 5, wherein said providing a second 
memory comprises providing a second memory having a 
size C. 

The method of claim 8, wherein said size C is based on an 
amount of data that may be transmitted to the port 
during a latency time required to stop transmission of 
the packets in response to said determining. 

The method of claim 9, wherein said latency time 
comprises an approximate amount of time required to 
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perform said transmitting flow control credits to the 
device to stop transmission of the packets in response 
to said determining. 

The method of claim 10, wherein said transmitting flow 
control credits to the device to stop transmission of 
the packets in response to said determining comprises 
transmitting a flow control packet with zero credits 
for each of a plurality of virtual lanes configured on 
the port . 

The method of claim 9, wherein said latency time 
comprises an approximate amount of time required for 
the port to transmit a maximum- sized Infiniband data 
packet to the device. 

The method of claim 9, wherein said latency time 
comprises an approximate amount of time required for 
the device to transmit a maximum- sized Infiniband data 
packet to the port . 

The method of claim 9, wherein said latency time 
comprises an approximate amount of time required for 
the device to respond to said transmitting flow control 
credits to the device to stop transmission of the 
packets in response to said determining. 
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The method of claim 8, wherein said size C is between 
approximately one Kilobyte and approximately sixteen 
Kilobytes . 

The method of claim 1, further comprising: 
buffering the packets transmitted by the device 
subsequent to said determining in a reserved 
amount of the portion of the memory, wherein said 
reserved amount is beyond the predetermined 
amount . 

The method of claim 16, wherein said reserved amount is 
between approximately eight Kilobytes and approximately 
sixteen Kilobytes . 

The method of claim 16, wherein said reserved amount is 
based on an amount of data that may be transmitted to 
the port during a latency time required to stop 
transmission of the packets in response to said 
determining . 

The method of claim 18, wherein said latency time 
comprises an approximate amount of time required for 
the port to transmit a flow control packet for each of 
a plurality of virtual lanes configured on the port. 
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The method of claim 18, wherein said latency time 
comprises an approximate amount of time required for 
the port to transmit a maximum- si zed Infiniband data 
packet to the device. 

The method of claim 18, wherein said latency time 
comprises an approximate amount of time required for 
the device to transmit a maximum-sized Infiniband data 
packet to the port . 

The method of claim 18, wherein said latency time 
comprises an approximate amount of time required for 
the device to respond to said transmitting flow control 
credits to the device to stop transmission of the 
packets in response to said determining. 

The method of claim 1, wherein said determining the 
portion of the memory is filled a predetermined amount 
comprises determining an amount of free space in the 
portion of the memory drops below the predetermined 
amount . 

The method of claim 23, wherein said amount of free 
space is between approximately eight Kilobytes and 
approximately sixteen Kilobytes. 



BAN: 0104 



The method of claim 1, wherein said providing a portion 
of a memory for buffering the packets comprises 
dynamically allocating the memory from a pool of memory 
shared among the port and a plurality of other 
Inf iniband ports . 

The method of claim 1, wherein said providing a portion 
of a memory for buffering the packets comprises 
providing the memory in response to user input . 

The method of claim 1, wherein said providing a portion 
of a memory for buffering the packets comprises 
providing the portion of the memory to the port based 
on a plurality of other ports sharing the memory with 
the port . 

The method of claim 1, wherein said transmitting flow 
control credits to advertise to the device buffering 
resources of a size B comprises advertising at least 
two maximum-sized Infiniband packets worth of flow 
control credits for each of a plurality of virtual 
lanes configured on the port. 

The method of claim 1 further comprising: 
configuring a plurality of virtual lanes on the port 
prior to said transmitting flow control credits to 
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advertise to the device buffering resources of a 
size B. 

The method of claim 29, wherein a product of said 
plurality of virtual lanes and a number of bytes 
comprising two maximum- sized Infiniband packet exceeds 
size A. 

A method for controlling flow of packets into a 
plurality of ports on an Infiniband device, comprising: 
providing a memory for buffering the packets, wherein 

the memory has a size A; 
transmitting flow control credits by the plurality of 
ports to advertise packet buffering resources of a 
size B, wherein B is greater than A; and 
transmitting flow control credits by at least one of 
the plurality of ports to stop transmission of the 
packets into the at least one port in response to 
determining an amount of free space in the memory 
drops below a predetermined threshold. 

The method of claim 31, wherein said transmitting flow 
control credits by the plurality of ports to advertise 
packet buffering resources of a size B comprises 
transmitting flow control credits for each of a 
plurality of virtual lanes configured on each of the 
plurality of ports. 
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The method of claim 31, wherein said predetermined 
threshold is based on an amount of data that may be 
transmitted to the plurality of ports during a latency 
time required to stop transmission of the packets in 
response to said determining. 

The method of claim 31, wherein said predetermined 
threshold is approximately zero, wherein said method 
further comprises : 

providing a second memory for buffering the packets 
transmitted subsequent to said determining. 

A system for buffering packets transmitted by a link 
partner linked to an Infiniband port, comprising: 
a first memory, for buffering the packets from the 
port ; 

flow control logic, configured to advertise to the link 
partner more buffering resources than are 
available in said first memory for buffering the 
packets if space is available in said first memory 
to buffer the packets, and to advertise no 
buffering resources if no space is available; and 

a second memory, coupled between the port and said 
first memory, for buffering the packets when no 
buffering resources are available in said first 
memory . 
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The system of claim 35, wherein said second memory is 
configured to receive the packets independent of a 
plurality of virtual lanes specified in the packets. 

The system of claim 35, wherein a size of said second 
memory is approximately an amount of data capable of 
being transmitted to the port, during a latency time 
from when no buffering resources are available in said 
first memory to when the link partner stops 
transmitting the packets. 

The system of claim 35, wherein said flow control logic 
is configured to advertise to the link partner said 
buffering resources for a plurality of virtual lanes 
configured on the port. 

A system for buffering packets transmitted by a link 
partner linked to an Infiniband port, comprising: 
a memory, having a size; 

an inline buffer, coupled between the port and said 
memory, for selectively buffering the packets if 
said memory is full; and 

flow control logic, configured to advertise to the link 
partner more flow control credits than space 
available in said memory, wherein said flow 
control logic is further configured to advertise 
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to the link partner zero flow control credits when 
said memory is full. 

The system of claim 39, wherein said flow control logic 
is configured to advertise to the link partner more 
flow control credits than space available in said 
memory across a plurality of virtual lanes configured 
on the port . 

A system for buffering packets transmitted by a link 

partner linked to an Infiniband port, comprising: 

a memory, for buffering the packets from the port ; 

a buffer controller, for monitoring an amount of free 

space in said memory; and 
flow control logic, configured to advertise to the link 
partner more buffering resources than are 
available in said memory for buffering the packets 
from the port if said buffer controller indicates 
said amount of free space is above a predetermined 
threshold. 

The system of claim 41, wherein said flow control logic 
is further configured to advertise to the link partner 
no buffering resources if said buffer controller 
indicates said amount of free space is below said 
predetermined threshold. 
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The system of claim 41, wherein said predetermined 
threshold is approximately an amount of data capable of 
being transmitted to the port during a latency time 
from when said buffer controller indicates said amount 
of free space is below said predetermined threshold to 
when the link partner stops transmitting the packets. 

The system of claim 41, wherein said flow control logic 
is configured to advertise to the link partner said 
buffering resources for a plurality of virtual lanes 
configured on the port. 

The system of claim 44, wherein said memory has a size, 
wherein said plurality of virtual lanes configured on 
the port multiplied by a size of at least two maximum- 
sized Infiniband data packets substantially exceeds 
said size of said memory. 

An Infiniband device, comprising: 

a plurality of ports, each having a plurality of 

virtual lanes configured therein; 
memory, for buffering packets received by said 

plurality of ports, said memory having a 

predetermined size; and 
flow control, for advertising an amount of buffering 

resources comprising at least two Infiniband 
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packets worth of flow control credits for each of 
said plurality of virtual lanes configured in each 
of said plurality of ports; 
wherein said advertised amount of buffering resources 
substantially exceeds said predetermined size of 
said memory. 

The device of claim 46, wherein said Infiniband device 
is an Infiniband switch, router or channel adapter. 

A buffering system in an Infiniband device, comprising: 
a port, having a plurality of virtual lanes configured 
therein; 

a memory, for buffering packets received by said port, 
said memory having a predetermined size; and 

flow control, configured to advertise an amount of 
buffering resources comprising at least two 
Infiniband packets worth of flow control credits 
for each of said plurality of virtual lanes 
configured in said port; 

wherein said advertised amount of buffering resources 
substantially exceeds said predetermined size of 
said memory. 

The buffering system of claim 48, wherein said flow 
control is further configured to advertise zero credits 
for each of said plurality of virtual lanes configured 
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in said port upon determining less than a predetermined 
amount of said memory is free to buffer said packets 
received from said port. 



